Comments on paper by B.Lesche (Phys. Rev. E 70, 017102 (2004)) 
"Renyi entropies and observables" 
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In 1982 Leshe published paper |l| on instability of the 
Renyi entropy. His paper was developed later by Abe 
0- From the time of their publications they are often 
referred as a mortal verdict for the Renyi entropy. 

This problem became the subject of our discussion 
with Abe 0,13 

Another attack on the Renyi entropy was recently 
launched by Lesche @- The most important points of 
his paper related to the subject are outlined in the fol- 
lowing paragraphs. 

He considers firstly an initial macrostate that charac- 
terizes by eigenvalues ai,bi, ...,hi of macroscopic corn- 
measurable observables A, B, H . The special charac- 
teristics of this kind of state are the following: 1) The 
number of occupied microstates Wj = W aii b t ,...,hi l& °f 
the order M N and therefore any individual probability 
(W/)- 1 is extremely small (of the order of M~ N ). 2) The 
number of empty microstates is larger than the number 
of occupied microstates by a huge factor, which is also 
of the order of M N . Essentially these two characteristics 
make this sort of state a problem case. 

This initial state is of the form 



= ^2 \ a i> b i' 



<hj,j) — (ai,bj, 



,h z ,j\ (1) 



where \ai,bi, ...,hi,j) is a basis of common eigenstates 
(Dirac's ket-vectors) and j is an index of degeneracy of 
the initial macrostate. 

All Renyi entropies of this state have the same value, 
which is the Boltzmann entropy of the macrostate 
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Now, imagine that a friend of ours enters the labo- 
ratory and criticizes our experiment. He claims our 
preparation of state may in some cases result in the 
macrostate [a, b,..., h] with the number of occupied mi- 
crostates W = W u i Now, if the probability of such 
cases, say, 8 = 10 -100 , we will not be able to convince our 
friend that our probability assignment is better than his 
by showing experimental results. His density operator 
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would be 



^2 \ a l,bi, ...,hi,j)-yy—(ai,bi 
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Tr 



+ y2\a,b,...,h,j) = (a,b,...,h,j\ 



(3) 



The Renyi entropy of the friend's probability assign- 
ment is 
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The first term is of order N. To estimate the second 
term we now distinguish the following two cases: (a) 
If q > 1, we shall assume that our friend thought of a 
state [a, b, h] with smaller entropy than the main state 
[a/, bi, hi], that is, 



W < Si- 1 Wi for q > 1 



(5) 



If S( B '(ai, bi, hi) — S^ B \a, b, h) is macroscopic (of 
the order N), the third term is clearly also negligible as 
compared to the first one. (b) If q < 1, we assume that 
the friend thought of a state [a, b, h] whose entropy is 
macroscopically larger than S^(ai,bi, hi), that is 



W > S l -i Wi for q < 1 
Again the second term will be negligible. 
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or 



§^(5) = \nW 
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(8) 

Then, according to Lesche, the second terms of this equa- 
tions are negligible as compared to the first ones (for in- 
stance, with N w 10 24 and S = 10~ 100 his argument is 
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restriction to q values with |1— q\ 3> 10~ 22 ). So, in either 
case, the Renyi entropy of the friends probability assign- 
ment would essentially be the entropy of the irrelevant 
state [a, b, h] 

S(R) ~lnW~ln{5- 1 W}, (9) 

which is far away from our initial value, Eq. (2). 

I begin my comments with the remark that Lesche did 
not touche the same problem for the Tsallis entropy in 
spite of that he thanks C. Tsallis and S. Abe for bring- 
ing his attention to the subject that he abandoned many 
years ago. 

The Tsallis entropy of the initial state p is 



sf s > = — (w]- q - 1 

H 1 — q \ 



q 

For the friend's probability assignment p it becomes 
1 
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With the use of the same speculations that have led 
Lesche to Eq. (9) the Tsallis entropy for both cases q > 1 
and q < 1 takes the form 
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So, we see that the Tsallis entropy is far away from its 
initial value, Eq. (10), as well as the Renyi entropy. 

Under restrictions (5) and (6) they both correspond 
to an equally probable distribution pj = (St^W)^ 1 (for 
all j) related to the friend's state [a, b, h] without re- 
gard for the iitial state [a/, bi, hi]. Just this result 
should be expected. Indeed, states with greatest (least) 
probabilities contribute significantly to both g-cntropies 
at q > 1 (q < 1). The restrictions (5) and (6) may be 
rewritten for the probabilities as 
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10?- 1 for q > 1; 
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Then, the resulted equations for Sq R ^ (5) and Sq Ts ^ (5) are 
to be accepted as quite natural, but not as evidences of 
their instabilities. 

It is interesting to discuss an alternative form of the 
Renyi and Tsallis entropies expansions. 

The more natural form of the Renyi entropy expansion 
should start with the Boltzmann entropy, Eq. (2), as a 



leading term of the expansion. Then 

S q R) (S) = -J-lnftl-J)^) 1 -* 

a: W, 
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The second term of this expansion is negligible when 1 1 — 
q\ 3> 5. The third term becomes negligible when the 
macrostate proposed by the friend fulfills the inequalities 
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or, taking into consideration that 8 = 10~ 100 , 
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(16) 
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We see that (5-pre-factors in both last inequalities alle- 
viate restrictions imposed on W, in contrast to the role 
of such (S-pre-factors in the inequalities (13), (14) of the 
Lesche's expansion. It means that the third term of our 
expansion can be neglected in much more numerous cases 
than the one of the Lesche expansion. In particular, cases 
of W ~ Wi are included here. 

It may be supposed that the macrostate [a, b, h] cho- 
sen by the Lesche's friend will fulfill inequalities (17) or 
(18), but not (13) or (14) with overwhelming probability, 
if only the friend is not a grandson of Maxwell's demon. 
So, the Renyi entropy of the friends probability assign- 
ment would be essentially the same Boltzmann entropy 
of our state 



S( R) (6) ~ hi Wi. 



(19) 



These arguments repel the Lesche's attack on stability 
of the Renyi entropy. 

The similar alternative expansion of the Tsallis entropy 
under the same restrictions gives rise to 

S^ Ts H5) = -}—{(l-5) q {Wi) 1 - q + 5 q (W) 1 - q -l} 

= -^-{l-5) q W]- q h+ Wl ~ 9 ~ 1 1 } 
l-q K 1 1 I (1 - 5)Wj~ q > 

- i^ja-w 1- '- 1 } 

- iK'" 1 } (2°) 
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Thus, we have get the Tsallis entropy of the initial state. 

The above speculations count in favor of stability of 
both Renyi and Tsallis entropies relative stochastic per- 



turbations of an initial macrostate with the uniform dis- 
tribution of probabilities of microstates. 
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